Factored LT and Factored Raptor Codes for Large-Scale Distributed Matrix Multiplication

نویسندگان

چکیده

We propose two coding schemes for distributed matrix multiplication in the presence of stragglers. These are adaptations Luby Transform (LT) codes and Raptor to termed Factored LT (FLT) codes (FRT) . show that all nodes Tanner graph a randomly sampled code have tree-like neighborhood with high probability. This ensures density evolution analysis gives reasonable estimate average recovery threshold FLT codes. The proposed is asymptotically optimal when output degree distribution Soliton. Empirically, we FRT an excellent while number worker moderately large. In addition, using Azuma–Hoeffding inequality, derive concentration results chosen close ensemble average. better thresholds compared Product they expected numerical stability Polynomial codes, can also be decoded low-complexity decoding algorithm. Finally, matched practically important case sparse matrix-matrix as many previous schemes.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Factored MCTS for Large Scale Stochastic Planning

This paper investigates stochastic planning problems with large factored state and action spaces. We show that even with moderate increase in the size of existing challenge problems, the performance of state of the art algorithms deteriorates rapidly, making them ineffective. To address this problem we propose a family of simple but scalable online planning algorithms that combine sampling, as ...

متن کامل

Distributed Planning in Hierarchical Factored MDPs

We present a principled and efficient planning algorithm for collaborative multiagent dynamical systems. All computation, during both the planning and the execution phases, is distributed among the agents; each agent only needs to model and plan for a small part of the system. Each of these local subsystems is small, but once they are combined they can represent an exponentially larger problem....

متن کامل

Factored Envisioning1

Envisioning has been used extensively to model behavior of physical systems. Envisioning generates the qualitatively distinct possible behaviors without numerically simulating every possible set of input conditions and model parameters. This paper applies envisioning to analyze course of action (COA) diagrams to determine the qualitatively distinct outcomes of military operations. In order to a...

متن کامل

Iteration for Factored MDPsDaphne

Many large MDPs can be represented compactly using a dynamic Bayesian network. Although the structure of the value function does not retain the structure of the process, recent work has suggested that value functions in factored MDPs can often be approximated well using a factored value function: a linear combination of restricted basis functions, each of which refers only to a small subset of ...

متن کامل

Reinforcement Learning for Factored

Reinforcement Learning for Factored Markov Decision Processes Brian Sallans Doctor of Philosophy Graduate Department of Computer Science University of Toronto 2002 Learning to act optimally in a complex, dynamic and noisy environment is a hard problem. Various threads of research from reinforcement learning, animal conditioning, operations research, machine learning, statistics and optimal cont...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: IEEE journal on selected areas in information theory

سال: 2021

ISSN: ['2641-8770']

DOI: https://doi.org/10.1109/jsait.2021.3103822